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CHAPTER  I 


INTRODUCTION 


In  recognition  of  our  national  energy  goals  and  to  reduce  the 
cost  of  training,  the  Air  Force  is  moving  toward  replacing  some  flight 
training  with  simulation.  Air  Force  policy  has  been  stated  as  follows: 

Department  of  Defense  guidance  has  been  issued  direct- 
ing all  the  Services  to  strive  for  a 25%  reduction  in'  flying 
hours  by  the  end  of  Fiscal  Year  1981  through  increased  use 
of  simulation.  In  addition  to  energy  considerations,  other 
issues  such  as  restricted  airspace,  environmental  and  eco- 
logical impacts,  safety  and  aircraft  attrition,  dictate  that 
the  Air  Force  aggressively  pursue  increased  use  of  flight 
simulators. 

To  meet  this  ambitious  goal  will  require  an  investment 
of  over  one  and  one-half  billion  dollars  over  the  next  five 
years  to  obtain  the  sophisticated  training  devices  that  are 
required. 

Mission  simulators  will  aid  greatly  in  reducing  the 
amount  of  flying  time  required  while  maintaining,  and  in 
many  cases  improving,  force  readiness  [6:27]. 


STATEMENT  OF  PROBLEM 


Flight  simulation  is  purported  to  be  a viable  alternative  to 
actual  flight  for  maintaining  pilot  proficiency.  Proponents  of  flight 
simulators  contend  that  state-of-the-art  simulators  provide  both  cost 
effectiveness  and  the  necessary  realism-in-training  to  maintain  the 
desired  level  of  pilot  proficiency  (5:1).  Opponents  of  flight  simulation 
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afi  a replacement  for  actual  flight  contend  that  an  adequate  level  of 
proficiency  can  best  be  maintained  through  hands* on -training  in  the 
actual  medium,  a key  factor  being  the  inability  of  flight  simulators  to 
provoke  the  psychological  stress  associated  with  actual  flight  (9:10). 

Brigadier  General  Norman  C.  Gaddis,  Deputy  Director  of 
Operations  and  Readiness,  DCS/Plans  and  Operations,  said  recently 
in  a talk  to  the  Naval  Training  Equipment  Center  Industry  Conference 
in  Orlando,  Florida: 

The  advocates  of  more  simulation  and  less  flying  are 
riding  on  a strong  wave  of  concern  over  increasing  cost  of 
fuel,  but  funds  for  simulators  will  have  to  compete  with 
other  Air  Force  programs  and  will  have  to  be  justified 
either  on  a very  strong  case  of  improved  force  readiness 
or  by  the  offer  of  savings  resulting  from  flying  hour  reduc- 
tions. There  are  some  who  believe  that  flying  hours  are 
inevitably  going  to  be  reduced.  If  that  is  true,  then  simu- 
lation may  be  our  only  alternative  to  reduced  force  readi- 
ness. Simulation  then  may  be  likened  to  false  teeth. 

Dentures  are  not  a substitute  for  teeth,  they  are  an  alterna- 
tive for  no  teeth.  Simulation  may  be  an  alternative  for  no 
tlying.  The  distinction  may  be  fine,  but  I think  the  analogy 
holds. 

However,  there  is  a rising  concern  in  the  Air  Force 
over  our  ability  to  meet  the  flying  hour  reduction  goal. 

This  concern  is  most  prevalent  with  our  fighter  force.  A 
significant  factor  in  the  effectiveness  of  our  fighters  is  the 
sortie  rates  that  can  be  generated.  Sortie  rate  is  much 
dependent  upon  the  efficiency  of  the  total  ground  support, 
supply,  administrative  services,  maintenance  and  logistics 
system.  To  be  efficient,  this  system  has  traditionally 
needed  considerable  exercise.  Uncompensated  flying  hour 
reductions,  for  whatever  reason,  will  impact  adversely 
upon  the  system  to  operate  efficiently  and  effectively.  We 
must  apply  the  "systems  approach"  to  our  training  concepts 
to  insure  that  some  training  problems  are  not  created  as 
others  are  solved  [7:1]. 
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This  thesis  effort  will  take  an  objective  look  at  simulator 
hours,  flying  hours  and  pilot  proficiency  to  determine  if  there  are 
trends  that  indicate  reduced  pilot  skills  since  the  implementation  of 
energy  conservation  measures  (1972),  which  dictated  increased  substi- 
tution of  simulator  training  for  actual  flight  training. 

DEFINITION  OF  TERMS 


Common  Aircraft 

Inventories  of  similar  types  of  aircraft. 

Energy  Conservation  Measures 

Measures  taken  to  conserve  fuel,  precipitated  by  the  recogni- 
tion of  serious  reductions  in  energy  sources  in  1972  (17:144). 

Fidelity 

Accuracy  of  simulation  (10:3-9).  The  degree  to  which  the 
simulator  incorporates  and  displays  features  such  as  visual,  aerial, 
and  kinesthetic  cues  which  foster  high-learning  transfer  on  complex 
tasks. 

Flying  Proficiency 

Acquired  skills  necessary  to  safely  accomplish  flight  mission 


requirements 
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JUSTIFICATION  FOR  RESEARCH 

One  of  the  primary  objectives  of  a peacetime  military  force 
is  to  maintain  a state  of  proficiency  through  training  to  permit  an 
instantaneous  and  decisive  response  to  any  global  threat  (12:22).  In 
order  to  insure  this  defense  posture,  the  degree  of  proficiency  of  our 
forces  must  be  adequately  assessed  and  adjusted  -where  necessary. 
Given  the  constraints  of  energy  conservation  and  cost  effectiveness, 
this  research  will  examine  pilot  proficiency  and  the  use  of  flight  sim- 
ulators as  a substitute  for  actual  flight. 

In  recent  years  the  Air  Force  has  made  significant  reductions 
in  aircrew  flying  hours  and  has  restructured  the  aircrew  force  in 
response  to  governmental  demands  for  more  effective  management  of 
fiscal  and  natural  resources.  The  Government  Accounting  Office 
(GAO)  previously  reported  to  the  Congress  that  the  military  services 
could  lower  costs  and  increase  pilot  proficiency  by  making  greater 
use  of  flight  simulators  (8:4).  The  report  cited  the  potential  cost 
savings  if  flying  were  reduced  and  pointed  out  that  increased  use  of 
simulators  could  help  ease  projected  fuel  shortages  and  enhance  the 
safety  and  effectiveness  of  pilot  training  programs.  As  a result,  the 
Air  Force  goal  is  to  reduce  aircraft  flying  hours  25  percent  by  the 
end  of  FY  1981.  This  goal  will  be  realised  through  the  increased 
emphasis  on  and  greater  use  of  flight  simulators  as  a supplement  to 
aircrew  training  in  maintaining  flying  proficiency  (14:4). 
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Currently,  the  Air  Force's  inventory  of  simulators  consists 
of  devices  that  vary  considerably  in  design,  complexity,  realism,  and 
training  purposes.  In  the  late  1940s,  analog  computers  were  used  to 
try  to  simulate  certain  cockpit  and  flight  characteristics  of  a particu- 
lar airplane.  More  sophisticated  simulators  have  since  been  developed 
which  use  digital  computers  and  modern  electronics  technology  to  pro- 
duce more  realistic  flight  dynamics  (fidelity),  such  as  motion,  visual, 
and  instrumentation  (5:12).  These  simulators  possess  the  entire 
complement  of  integrated  systems  necessary  to  accomplish  almost 
total  mission  requirements.  The  disparity  of  complexity  among  exist- 
ing simulators  points  out  a fundamental  acquisition  problem,  which  is 
the  lack  of  knowledge  concerning  how  complex  and  costly  simulator 
hardware  must  be  in  order  to  provide  effective  flying  training  for  dif- 
ferent missions. 

Air  Force  simulator  acquisition  is  being  driven  more  by 
available  technology  than  by  requirements  based  on  scientific 
research  findings.  For  example,  more  data  are  required 
concerning  the  kind  and  amount  of  motion  required  and  the 
extent  and  fidelity  of  visual  simulation  necessary  to  achieve 
effective  training  in  different  flight  regimes  [14:4]. 

Proponents  of  flight  simulators  contend  that  state-of-the-art 
simulators  are  both  cost  effective  and  provide  the  necessary  realism- 
in-training  to  maintain  the  desired  level  of  pilot  proficiency  (2:E-76). 
This  contention  has  given  impetus  to  simulator  design  and  development. 

The  Comptroller  General  lists  the  following  major  simulator 
projects  affecting  large  multiengine  aircraft: 


7 


MAC  is  requesting  funds  for  incorporating  visual  sys- 
tems, similar  to  the  one  used  in  transition  training  at 
Altus  AFB,  Oklahoma  on  all  C-5  and  C-141  aircraft  simu- 
lators. 

SAC  has  formalized  requirements  for  a B-52  refueling 
part-task  trainer  and  a related  KC-135  boom  operator 
trainer  with  visual  attachments. 

SAC  is  developing  plans  and  requirements  for  current 
state-of-the-art  simulators  with  visual  systems  and  6°  of 
motion^  for  both  the  B-52  and  KC-135  aircraft. 

Tactical  Air  Command  has  established  requirements 
for  10  new  C-130  flight  simulators  with  6°  of  motion  and  a 
flexible  visual  system  having  a wide  enough  field  of  view  to 
perform  take-off,  enroute,  approach,  and  landing  tasks. 

Air  Training  Command  is  constructing  a navigation  sim- 
ulator (designated  the  T-45)  complex  at  an  estimated  cost  of 
$21  million  for  use  in  Undergraduate  Navigator  Training  at 
Mather  AFB,  California.  A simulator  (designated  the  T-5) 
for  electronic  warfare  training  was  accepted  by  Air  Force 
at  Mather  in  November  in  1973  [5:39]. 

Air  Training  Command  is  proposing  the  TS-2  and  TS-3  for  future 

Undergraduate  Pilot  Training. 

The  TS-2  simulator  is  considered  for  near  term  (1977) 
application  in  the  instrument  phase.  The  digitally  driven 
six  degree-of-freedom  (DOF)  motion  system  provides 
kinesthetic  cues  and  faithful  handling  qualities.  Each  mem- 
ber of  the  IP  panel  flew  state-of-the-art  simulators  which 
have  six  DOF  motion  systems.  . . . The  instructor  pilots 
were  unanimous  in  the  opinion  that  simulators  of  this  type 
employing  a visual  system  as  described  for  the  TS-2  could 
replace  all  instrument  training,  both  to  initial  capability 
and  for  reinforcement  [3:H-35l. 

The  TS-3  simulator  is  projected  for  the  post- 1980  time 
period.  It  will  have  additional  capabilities  over  the  TS-2  by  use  of  an 
extremely  wide  angle  visual  scene.  It  will  be  used  for  tasks  requiring 


*6°  of  motion  includes  roll,  pitch,  yaw,  lateral,  longitudinal, 
and  vertical  movements. 
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visual  cues  in  the  contact,  navigation,  formation,  end  specialized 
phases  (3:50-52). 

Both  the  TS-2  and  TS-3  are  proposed  for  Undergraduate  Pilot 
Training  to  significantly  reduce  actual  flight  in  the  T-37  and  T-38  air- 
craft respectively.  The  associated  cost  savings  are  a major  driving 
force  in  Air  Force  acceptance  of  simulator  training. 

The  cost  savings  with  the  TS-2  simulator  is  $578  mil- 
lion and  with  the  TS-2  and  TS-3  simulators  the  savings  are 
projected  to  be  $848  million.  This  is  due  to  the  combined 
effect  of  a lower  investment  in  aircraft  and  their  avionics, 
a higher  terminal  value,  and  a lower  annual  operating  cost 
[4:1-64]. 

Although  the  purported  savings,  as  they  are  presented,  indi- 
cate simulators  to  be  the  best  possible  alternatives,  an  in-depth 
analysis  of  the  total  impact  of  simulation  has  not  been  made.  For 
example,  simulator  cost  studies  did  not  address  the  affect  of  simula- 
tion on  the  maintenance  learning  curve  due  to  reduced  hands-on- 
training  for  flight  maintenance  personnel.  Cost  impact  studies  did  not 
address  increased  routine  maintenance  cost  associated  with  stand-down 
aircraft  (15:1-107). 

One  area  of  major  concern  is  the  impact  of  increased  simula- 
tion on  pilot  proficiency.  This  study  will  specifically  address  simula- 
tion and  flying  hours  as  they  relate  to  pilot  proficiency. 
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ACCIDENT  STATISTICS  AS  A MEASURE 
OF  PILOT  PROFICIENCY 

One  of  the  major  objective*  of  any  flight  training  program  i* 
to  produce  a safe  pilot.  A*  stated  by  Johnson,  "The  goal  i*  to 
increase  his  proficiency  to  the  point  where  he  is  a reliable  component 
of  the  operational  system  [10:3]."  Safety  and  proficiency  are  inter- 
related. Accidents  resulting  from  pilot  error  can  be  considered  a 
measure  of  pilot  improficiency,  or,  a reciprocal  measure  of  pro- 
ficiency. 

For  purposes  of  quantifying  pilot  errors,  accident  reports 
maintained  at  the  Air  Force  Inspection  and  Safety  Center,  Norton 
AFB,  California,  were  obtained  and  analyzed.  Major  aircraft  acci- 
dents for  1970  through  1975  were  analyzed  and  presented  in  this 
report.  These  years  were  chosen  to  represent  an  equal  time  distri- 
bution before  and  after  the  implementation  of  energy  conservation 
and  cost  effective  measures  (1972).  For  the  final  comparison,  1970 
through  1972  will  be  compared  with  1973  through  1975.  Only  major 
aircraft  accidents  resulting  from  pilot  errors  were  analyzed.  To 
present  conservative  figures,  only  major  aircraft  accidents  com- 
mitted by  pilots  with  over  700  hours  total  first  pilot/instructor  pilot 
time  were  considered.  Seven  hundred  hours  is  consistent  with  Air 
Training  Command's  definition  of  an  experienced  pilot.  To  avoid 
errors  in  comparing  the  cost  of  1970  inventory  aircraft  with 


different  end  more  expensive  aircraft  of  later  vintage,  only  common 
aircraft  were  considered.  Additionally,  accidents  in  which  battle 
damage  was  a contributing  factor  were  not  considered. 

Total  flying  time  for  the  period  considered  was  reduced  by 
approximately  10%  by  1975  due  to  increased  commitments  in  South- 
east Asia  plus  implementation  of  energy  conservation  and  cost 
effective  measures  (10).  This  factor  was  not  considered  in  the 
analysis,  resulting  in  more  conservative  figures.  Also,  the  accident 
costs  figures  presented  were  converted  to  1970  dollars  by  using  price 
deflators  published  in  Economic  Indicators  (July  1976).  The  follow- 
ing is  a list  of  the  price  deflators  used  in  costs  conversions: 


Year 


Deflator 


1970 

1971 

1972 

1973 

1974 

1975 


0 

2.7 

3.3 

6.2 

11.0 

9.2 


Converting  all  costs  to  1970  dollars  negates  the  affect  of  infla- 


tion and  thus  allows  a direct  comparison  of  the  costs  of  pilot  errors 


which  resulted  in  major  aircraft  accidents. 


CHAPTER  II 


RESEARCH  METHODOLOGY 


Overview  of  Research 


Cause: 


Effect: 


Solution: 


Research: 


Cost  Effectiveness 

1972 

Energy  Conservation 


| Reduced  Flying  Time 

| Increased  Use  of  Simulators 

( 

/ Effect  on  Pilot  Proficiency? 


INFORMATION  REQUIREMENTS 


The  following  research  hypotheses  were  tested: 

(I)  There  has  been  a decrease  in  total  pilot  flying  profi- 
ciency since  1972  (ECM  implementation). 

(II)  The  decrease  in  flying  proficiency  can  be  attributed  to 
reductions  in  actual  flight  hours  and  to  increases  in  the  use  of  flight 
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simulators  as  a substitute  for  actual  flight  in  maintaining  flying 
proficiency. 

To  evaluate  these  hypotheses  an  analysis  of  Air  Force 
historical  statistical  data  (1970-1975)  was  made.  The  statistical 
data  chosen  for  analysis  are:  (1)  Aircraft  Accident  Summaries, 

(2)  Total  Flying  Hour  Reports,  and  (3)  Reports  of  Total  Simulator 
Hours.  Data  on  aircraft  accidents  and  flying  time  were  obtained 
from  the  Air  Force  Inspection  and  Safety  Center,  Norton  AFB.  The 
accident  data  are  a census  of  pilot  error  accidents  for  1970  through 
1975.  Total  Air  Force  flying  time  was  obtained  for  the  same 
period.  Total  simulator  hours  were  obtained  from  Air  Force  Logis- 
tics Command  (ACVMP),  Wright-Patterson  AFB,  and  include  only 
those  hours  in  direct  support  of  aircrew  training.  These  statistical 
data  were  used  to  derive  an  average  yearly  cost  of  pilot  error 
(improficiency  cost).  "Improficiency  cost"  is  used  to  inversely 
measure  flying  proficiency.  Pilot  flying  proficiency  has  been  prev- 
iously defined  as  the  possession  of  those  acquired  skills  necessary  to 
safely  accomplish  flight  mission  requirements.  This  information  was 
used  to  test  hypothesis  (I).  To  determine  each  of  the  yearly  improfi- 
ciency costs  it  was  necessary  to  know  the  total  number  of  major 
accidents,  the  total  dollar  value  of  the  accidents,  and  the  accidents 
resulting  from  pilot  error  in  which  the  pilots  involved  had  more  than 
700  hours  total  first  pilot/ ins  true  tor  pilot  time. 
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In  addition,  the  association  of  the  total  hours  flown  and  the 
total  simulator  hours  used  for  each  year  of  the  historical  period  was 
determined.  From  the  information  obtained,  the  values  of  these  two 
variables  were  measured.  These  variables  are  defined  as  follows: 

a.  AFT^--The  total  actual  flying  time  (hours)  flown  for  a 
given  period  (i).  This  variable  is  a discrete  variable  of  the  infinite 
data  level.  This  variable  is  utilized  in  the  calculation  of  (P^)  which 
is  defined  below. 

b.  SFT^--The  total  simulated  flying  time  (hours)  for  a given 
period  (i).  This  variable  is  a discrete  variable  at  the  infinite  data 
level.  This  variable  is  utilized  in  the  calculation  of  (P^)  which  is 
defined  below. 

c.  P^--The  level  of  pilot  proficiency.  (Pj)  is  a function  of 
(AFT4  + SFT^).  (P|)  is  a discrete  dependent  variable  at  the  ratio 
level  and  is  utilized  in  deriving  the  statistics  to  be  used  in  hypothesis 
test  (II). 

A further  analysis  of  aircraft  accidents  was  made  and  pre- 
sented in  Chapter  IV.  This  analysis  examined  the  interrelationship 
of  phase  of  flight,  instructor  pilot/first  pilot  time,  simulator/flight 
ratio,  aircraft/type  and  cost  of  pilot  error.  These  data  are  computer 
analyzed  using  the  Statistical  Package  for  the  Social  Sciences  (SPSS). 

Chapter  V presents  a computer  model  used  to  predict  the 
level  of  pilot  proficiency  (Pi),  given  flying  hours  and  simulator  hours. 
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The  model  was  developed  using  historical  data  and  is  valid  only  for 
the  range  of  observed  data. 

POPULATION  DESCRIPTION 


Air  Force  Pilots 

Air  Force  pilots  have  undergone  rigorous  training  to  insure 
that  at  least  the  minimum  acceptable  level  of  pilot  proficiency  is  , 
attained.  The  initial  training  is  accomplished  during  53  weeks  of 
Undergraduate  Pilot  Training  (UPT).  Prior  to  graduation  each  pilot 
must  satisfactorily  demonstrate  safety  and  proficiency  in  all  phases 
of  aircraft  flight. 

Today,  the  UPT  program  represents  an  amalgamation  of  user 
requirements,  training,  and  economic  pressures.  UPT  operates 
under  the  philosophy  that  all  graduates  should  be  "universally  assign- 
able" (qualified  to  fly  any  aircraft  in  the  USAF  inventory);  therefore, 
all  students  receive  the  same  training  in  the  same  training  vehicles. 
The  training  vehicles  follow  the  building -block  concept  of  flight  train- 
ing with  the  T-41  low-performance  aircraft  used  as  a screening 
device  and  providing  some  introductory  flight  training.  The  second 
phase  of  training  is  accomplished  in  the  T-37,  a medium-performance 
jet  trainer  used  as  a fundamentals  vehicle  in  which  all  phases  of 
flight  are  introduced.  Finally,  the  T-38  high-performance  jet  trainer 
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is  used  to  elevate  fundamental  skills  and  establish  orientation  to  the 
capabilities  of  modern  operational  aircraft  (1:4). 

Ground  training,  in  support  of  flight  training,  consists  of 
lecture-oriented  classroom  subjects  which  are  time-phased  to  pro- 
vide the  lead-in  knowledge  for  flight  application. 

Ground-based  simulation  in  current  UPT  consists  of  non- 
motion, nonvisual  flight  instrument  trainers.  These  devices  (not 
actually  simulators)  were  introduced  in  the  early  1960s.  The  devices 
are  used  primarily  as  procedures  trainers.  Missions  flown  in  the 
trainers  are  prerequisites  for  identical  instrument  missions  in  the 
aircraft. 

For  the  purpose  of  this  report,  the  pilots  in  command  of  air- 
craft involved  in  major  accidents  were  assumed  to  be  current  in  that 
aircraft.  This  assumption  is  valid  based  on  Air  Force  Regulation 
51 -XX  which  requires  pilot  upgrading  prior  to  operational  flights  as 
pilot  in  command. 

There  are  currently  two  measures  of  pilot  proficiency  in  use 
at  MAJ COM  level:  (1)  Inspector  General  flight  evaluations,  and  (2) 
Aircraft  accidents  resulting  from  pilot  errors  (pilot  improficiency). 
The  former  was  not  considered  in  this  research  because  of  its  subjec- 
tive nature.  To  quantify  pilot  proficiency,  average  cost  per  pilot 
error  accident  was  used  as  a direct  measure  of  Improficiency.  The 
inverse  of  pilot  error  cost  is  the  measure  of  proficiency.  That  is. 
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as  pilot  error  cost  (improficiency)  increases,  proficiency  must 
decrease. 

To  determine  trends  in  pilot  proficiency,  variances  in  pilot 
error  cost  were  computed.  Variances  were  categorized  in  two 
groups  to  ascertain  the  changes  in  pilot  proficiency  before  and  after 
implementation  of  energy  conservation  measures  (1972). 

Accidents 

Air  Force  Regulation  127-4,  Investigation  and  Reporting  U.  S. 
Air  Force  Accidents  and  Incidents,  outlines  the  reporting  criteria 
for  aircraft  accidents  used  in  this  research  (l6:A6-3). 

Accidents  considered  in  this  research  (Reference  Tables  2-2 
to  2-7)  were  categorized  as  major  in  that  the  aircraft  were  destroyed 
or  received  substantial  damage.  Destroyed  is  defined  as  damage  that 
renders  the  aircraft  of  no  further  value  except  for  possible  salvage 
parts.  It  includes  repairable  aircraft  which  must  be  abandoned  or 
salvaged  because  moving  the  aircraft  from  the  mishap  scene  is 
impracticable  or  because  the  manhours  or  cost  of  repair  exceeds  the 
economical  standards.  Substantial  damage  is  defined  as  damage  in 
which  the  total  direct  manhours  to  remove,  repair,  and  replace  the 
damaged  component(s)  equals  or  exceeds  the  limit  set  for  that 
particular  type  and  model  of  aircraft;  or  damage  in  which  a major 
component  is  destroyed/damaged  beyond  economic  repair  at  any 
level  (2tA6-3). 


Accidents  considered  were  major  aircraft  accidents  in  which 
the  Accident  Investigation  Board  determined  pilot  error  (improfi- 
cieacyj  to  be  the  primary  cause. 

Major  aircraft  accidents  were  defined  as  those  which  involved 
pilots  with  more  than  700  hours  of  total  flying  time.  This  limitation 
resulted  in  conservative  dollar  estimates  from  which  to  judge  pilot 
proficiency.  The  assumption  is  that  pilots  with  more  than  700  hours 
should  have  acquired  the  necessary  experience  to  perform  with  an 
optimum  degree  of  pilot  proficiency.  Further,  it  allows  for  the 
assumption  of  homogeneity  in  pilot  skills. 

For  accidents  in  which  fatalities  occurred,  figures  on  accident 
related  fatalities  are  based  on  one  fatality  per  accident.  This  resulted 
in  parity  of  fatality  statistics  between  single  place  aircraft  and  multi- 
place aircraft. 

The  cost  per  accident  was  determined  by  the  Accident  Investi- 
gation Board.  These  costs  were  based  on  the  acquisition  cost  of  the 
aircraft.  Cost  figures  used  in  this  research  are  based  on  aircraft 
which  were  in  the  USAF  inventory  in  1970.  That  is,  new  aircraft 
acquired  since  1970,  such  as  the  F-15,  were  not  considered.  This 
limitation  was  necessary  in  order  to  reduce  the  error  of  comparing 
older  vintage  aircraft  with  newer,  more  expensive  aircraft.  Addi- 
tionally, all  accident  costs  were  converted  to  1970  dollars.  Data  are 
not  available  to  determine  the  ratio  of  labor  cost  to  parts  cost  for 
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f accidents  in  ‘which  the  aircraft  were  not  destroyed.  Although  convert- 

ing cost  to  1970  dollars  allows  for  direct  comparison,  the  following 
comparison  shows  that  direct  labor  was  involved  in  few  of  the  1970- 
1975  major  aircraft  accidents  because  the  majority  of  the  pilot  error 

t accidents  resulted  in  total  destruction  of  the  aircraft.  A comparison 

of  the  percent  of  aircraft  destroyed  and  the  percent  repaired  from 
1970  through  1975  is  given  in  Table  2-1.  Figure  2-1  graphically 
depicts  percent  of  aircraft  destroyed,  and  Tables  2-2  through  2-7 
depict  the  population  of  aircraft  accidents  from  pilot  errors  (1970- 
1975). 

Table  2-1 

Aircraft  Destroyed  vs  Repaired 


Year 

Destroyed 

Repaired 

Total  Number 
of  Accidents 

% 

Repaired 

% 

Destroyed 

1970 

50 

15 

65 

23 

77 

1971 

24 

7 

31 

22 

78 

1972 

32 

13 

45 

41 

59 

1973 

15 

3 

18 

17 

83 

1974 

26 

7 

33 

21 

79 

1975 

18 

3 

21 

14 

86 

Percent  Destroyed 
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Aircraft  Destroyed,  Percent  Attributable  | 

to  Pilot  Error  (1970-1975)  | 


The  figures  above  are  for  major  aircraft  accidents;  primary  cause 
pilot  error;  pilots  with  over  700  hours;  common  aircraft;  no  battle 
damage. 
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Table  2-2 
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Population  of  Major  Aircraft  Accidents 
Resulting  from  Pilot  Error  (1975) 


Type 

A/C 

Cost 

Total 

IP/FP 

Time 

Destroyed 

Fatality 

Phase  of 
Flight 

A-7 

2,517,000 

2777 

1 

0 

4 

A-7 

2,526,468 

1244 

1 

1 

2 

A-7 

6,000 

791 

0 

0 

4 

A-7 

2,  526,  000 

1272 

1 

1 

2 

A-7 

2,517,000 

2529 

1 

0 

4 

A-37 

445, 500 

797 

1 

1 

4 

A-37 

447, 000 

1730 

1 

0 

5 

FB-111 

9,828,000 

1828 

1 

0 

5 

F-4D 

1,  947, 194 

1257 

1 

1 

3 

F-4C 

2, 327, 000 

6216 

1 

0 

3 

F-104C 

169,625 

1399 

0 

0 

2 

F-105G 

5,000 

750 

0 

0 

4 

F-106A 

3,699,641 

1622 

1 

0 

3 

F-111E 

11,877,  136 

2155 

1 

o • 

1 

F-111F 

10,970,  000 

1057 

1 

0 

4 

02A 

91,631 

2606 

1 

1 

3 

VT-29D 

980,000 

4940 

1 

1 

4 

T-33A 

148,000 

2103 

1 

0 

4 

T-33A 

148, 000 

1416 

1 

0 

4 

T-39A 

810,000 

1416 

1 

1 

3 

OV-10A 

461,893 

1388 

1 

1 

3 

Note: 


F 

I- 


Phases  of  Flight:  1 — Low  Level,  2- -Air  Ground  Ordnance 
Delivery,  3 --In -Flight  Normal,  3- -Takeoff  and  Climb  Out, 
4--Descent  and  Landing. 


I' 

* 


r. 


5 
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i 

3 
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Table  2-3 

Population  of  Major  Aircraft  Accidents 
Resulting  from.  Pilot  Error  (1974) 


Type 

A/C 

Cost 

Total 

IP/FP 

Time 

Destroyed 

Fatality 

Phase  of 
Flight 

A-7 

2, 479,  000 

864 

1 

1 

1 

A-7 

2,526,  289 

1778 

1 

1 

2 

A-7 

2, 663,089 

1095 

1 

0 

3 

B-52 

8,  039,  000 

1192 

1 

1 

5 

B-52 

6,562,  875 

919 

1 

1 

4 

C-130 

2, 064, 000 

760 

1 

1 

5 

KC-135 

3,393,000 

2376 

1 

1 

5 

RF-4C 

2,327,968 

2319 

1 

0 

4 

RF-4C 

2,  575,403 

749 

1 

1 

3 

F-4D 

1,915.051 

836 

1 

1 

1 

F-4D 

1,681,592 

1609 

1 j 

0 

4 

F-4D 

28, 885 

1624 

0 

4 

F-4E 

2,  488,  000 

1864 

1 

0 

3 

F-100F 

804, 444 

3101 

1 

1 

4 

RF-101C 

1,276,  145 

3266 

1 

1 

4 

F-101B 

323,  966 

1082 

.V.=.  v, 

0 

4 

F102A 

1,  173,  995 

2292 

i 

2 

TF-104G 

12,513 

2103 

0 

0 

4 

F-105D 

2,  136,668 

3731 

1 

0 

3 

F-105D 

105,811 

1155 

0 

2 

F-106A 

64, 703 

2839 

0 

0 

4 

F-106A 

4,692, 173 

3103 

1 

1 

3 

F-111D 

1,  195,  371 

2096 

0 

0 

4 

F-111F 

13,  195,500 

1355 

1 

1 

2 

HH-1H 

186, 199 

3743 

0 

0 

4 

02A 

91,631 

1086 

1 

1 

3 

02A 

92, 188 

1587 

1 

1 

2 

VT-29C 

843, 880 

2161 

1 

0 

4 

T-38A 

756, 000 

1916 

1 

1 

4 

T-38A 

753, 000 

1395 

1 

1 

2 

U-1A 

6,635 

789 

0 

0 

4 

U-1A 

121,540 

3911 

1 

0 

5 

U-10A 

72,725 

3366 

1 

1 

4 

Note*  Phases  of  Flight:  l--Low  Level,  2 — Air  Ground  Ordnance 
Delivery,  3 --In -Flight  Normal,  3- -Takeoff  and  Climb  Out, 
4--Descent  and  Lending. 
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Population  of  Major  Aircraft  Accidents 
Resulting  from  Pilot  Error  (1973) 


Type 

A/C 

Cost 

Total 

EP/FF 

Time 

Destroyed 

Fatality 

F-4D 

1,  976,373 

2432 

1 

0 

F-111E 

12,  337,234 

2427 

1 

0 

T-39A 

400,000 

3202 

0 

0 

F-102A 

1,251,209 

3217 

1 

1 

F-4E 

2,  349,592 

1438 

1 

1 

F-100F 

44,425 

4551 

o 

0 

F-4D 

1,681,593 

1061 

1 

1 

F-111A 

537,715 

2818 

0 

0 

T-33A 

147,810 

2765 

1 

1 

KC-135A 

2,  843,  924 

978 

i 

1 

F-111D 

13,688,807 

3700 

1 

1 

TH-1F 

272,931 

1317 

1 

F-104G 

1,  359,  000 

2559 

1 

i 

F-4E 

456,831 

3449 

0 

0 

WB-57C 

1,  106,930 

2801 

1 

1 

F-106A 

3,  305,435 

7438 

1 

1 

F-102A 

1,  183,995 

1027 

1 

0 

T-39A 

212,101 

3583 

0 

F-111A 

80,635 

6010 

i 

0 

F-4C 

1,898,365 

5165 

i 

0 

A-7D 

2,515,335 

2917 

i 

1 

F-100C 

9,  300 

1240 

0 

F-106A 

3,  353,781 

1768 

1 

0 

F-4E 

2,430,657 

2968 

1 

HI 

T-37B 

131,292 

1211 

1 

0 

F-4E 

2,430,657 

710 

1 

1 

C-130E 

2,  021,463 

898 

1 

1 

UH-1N 

449,259 

260 2 

1 

1 

HH-3E 

1,065,922 

3251 

1 

1 

A-7D 

3,045,027 

1852 

1 

1 

F-111D 

13,688,807 

1273 

1 

1 

Phase  o: 
Flight 


4 

5 
4 
4 

2 


A-37A 

KC-135A 

F-4E 

C-130A 

F-4D 

F-4E 

QU-22B 

C-124C 

F-106A 

T-38A 

F-4D 

F-4E 

A-37B 

FB-111A 

A-37B 

YF-4E 

HH-34J 

F-4D 

F-4D 


Cost 


351,441 

145. 000 
2,  349, 592 

19,700 

1,942,512 

125,371 

375. 000 
1,646,406 

275,279 
757,833 
1,681,593 
2,  640,  143 
440,437 
744, 722 
439,  868 
1,898,  365 

380. 000 
1,928,465 


Table  2-5  (continued) 


Total 

IF/FP 

Time  Destroyed 


3359 

1365 

1276 

2621 

912 

1426 

816 

5531 

1858 

4274 

1578 

1842 

1547 

2388 

839 

4770 

2052 

1193 

2063 


Phase  of 
Flisht 


RF-4C 

F-102A 

F-101B 

F-101B 

F-4E 


145, 350 

1,  032,  594 

7,732 

1,754,066 

2,  349,  592 


3361 

1088 

1695 

1251 

2196 


F-4D 

1,  935,  339 

828 

1 

1 

RF-4C 

2,  340,  691 

2158 

1 

1 

F-104G 

1,359,000 

2228 

1 

1 
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Table  2-6 

Population  of  Major  Aircraft  Accident! 
Resulting  from  Pilot  Error  (1971) 


F-101B 

C-7A 

F-100C 

F-105B 

F-4C 

F-5C 

F-4E 

C-47D 

F-4D 

UH-1F 

F-100D 


F- 


F-102A 
OV-lOA 
F-111E 
VC-47  A 


Cost 


1,  545,  649 
960, 000 
663, 181 
5,  649,  543 
1,898,365 

i ana 


3,252,  371 
1,496,  380 
9 

296, 960 
268,  341 
92,  188. 

2,  979,  745 
2, 401,068 
2,459, 142 
1,027,  100 

305, 649 

3,  305,435 

7,  864 
2,  292,  500 
1,  940,400 


1411 

950 

1210 

2735 

4543 

743 

1069 

2261 

I960 

2434 

1789 

4164 

5393 

4604 

2333 

1506 

4301 

1095 

1734 

2254 

1245 

4190 

2633 

1558 

948 

1208 

1537 

4064 

1238 

3078 

1066 

1916 

1697 
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Table  2-6  (continued) 


Type 

A/C 

Cost 

Total 

IP/FP 

Time 

Destroyed 

Fatality 

Phase  of 
Flight 

F-101A 

10, 900 

6025 

0 

0 

5 

U-2A 

2, 450, 000 

1740 

1 

1 

5 

F-111A 

1, 946, 989 

3113 

0 

0 

4 

F-102A 

1,  183,  995 

4500 

1 

0 

3 

Table  2-7 

Population  of  Major  Aircraft  Accidents 
Resulting  from  Pilot  Error  (1970) 


Cost 


2,332,210 
1,754,066 
1,898,  365 
769,  330 
147,810 
36, 747 
2,459,  142 
804, 444 
392, 982 
260,650 
667, 608 
1,822,214 
299,009 
769, 330 
1, 183, 993 
4,  000 
1,981.409 
1,278,828 
22, 934 
1,681,593 
235,659 
792,722 
3,  066,  501 
304, 000 
147,810 

2,  334,  844 
1,681,593 
1,604,  963 

171,557 

3,  250,  000 
272, 931 

19,522 
365,699 
2,  399,758 


Total 

IP/FP 

Time 


7140 

1081 

2124 

5073 

2030 

2156 

4374 

1282 

3466 

704 

2296 

4695 

5115 

2537 

2028 

1401 

4230 

5115 

1394 

2091 

4688 

732 

2815 

1924 

3123 

3564 

735 

2356 

8641 

1801 

1420 

2036 

2275 

771 
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Table  2-7  (continued) 


Total 

Type 

IP/FP 

A/C 

Cost 

Time 

T-38A 

764, 868 

2398 

OV-lOA 

506, 365 

1393 

Phase  of 
Flieht 
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Simulators 

1972  marked  the  implementation  of  increased  use  of  flight 
simulators  as  a substitute  for  actual  flight.  Ground-based  simulators 
are  generally  less  expensive,  easier  to  handle  and  to  maintain,  and 
independent  of  weather  (3:3).  Examples  of  various  types  of  simula- 
tors are  equipment  simulators  (e.g. , the  F-lll  simulator  and  other 
piloted  simulators  in  which  a human  operator  performs  a control 
task);  environment  simulators  (e.g.,  the  lunar  surface  simulator); 
situation  simulators  (e.  g.  , simulation  of  turbulence,  attack, 
approach,  or  landing);  condition  simulators  (e.g.,  instrument  flight 
conditions,  visual  flight  conditions,  night  or  daylight,  zero-G);  and 
procedures  or  mission  simulators  (e.g.,  for  combat,  space  flight, 
supersonic  transport  profile)  (4:5). 

Simulators  have  been  categorized  as  "part-task"  and  "whole- 
task"  simulators,  A part-task  simulator  is  defined  as  a device  which 
represents  only  specific  characteristics  or  functions  of  the  task, 
such  as  radar  observation,  navigation,  or  fire  control.  An  illustra- 
tion of  a part-task  simulation  is  the  pilot's  job  to  position  a target  in 
the  center  of  a radar  scope.  In  contrast,  the  whole-task  simulation 
has  been  defined  as  the  "deliberate  effort  to  achieve  complete  repre- 
sentation of  equipment  characteristics  and  in-flight  mission  factors 
[3:1]."  The  latter  include  the  environmental  factors  which  are  thought 
to  be  important.  Examples  of  whole-task  simulators  are  the  space 


flight  simulators  which  were  used  by  the  astronauts  for  the  simula- 
tion of  the  Mercury,  Gemini,  and  Apollo  missions. 
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Another  grouping  of  simulators  is  by  fixed-base  or  station- 
ary and  moving-base  or  dynamic  simulators.  The  first  group  con- 
sists mostly  of  cockpits  of  aircraft  or  facilities,  in  which  a pilot  or 
an  aircrew  can  become  familiar  with  the  flight  instruments,  their 
arrangement,  and  certain  operating  procedures  in  the  absence  of 
dynamic  and  motion  cues.  These  cues  are  available  in  the  moving- 
base  simulator.  In  order  to  obtain  dynamic  responses  of  the  pilot  or 
the  vehicle,  cockpits  of  aircraft  and  entire  space  capsules  have  been 
placed  on  wheels,  gimbals,  pulleys,  or  air  bearings  (3:2). 

The  driving  force  behind  use  of  simulators  as  a substitute 
for  actual  flight  is  the  theory  of  learning  transfer.  Learning  transfer 
is  a concept  which  derives  both  from  learning  theory  and  from  prac- 
tice. In  both  instances  it  has  been  shown  that  skills  acquired  in  a 
particular  situation  can  be  successfully  transferred  to  a similar  situ- 
ation. This  principle  has  long  been  applied  to  flying  training. 
Although  Link  Trainers,  which  were  the  first  simulators  used  to  this 
end,  were  rather  crude  devices  for  instrument  flight  training,  they 


proved  useful  for  practicing  navigation  owing  to  the  positive  transfer 
of  learned  behavior  patterns  from  one  situation  to  the  other.  If  the 
learned  functions  disturb  each  other,  negative  transfer  occurs.  On 
the  basis  of  present  evidence  it  appears  that  flight  simulators 
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generally  are  very  useful,  but  that  the  amount  of  transfer  of  skill 
from  the  simulator  to  the  aircraft  depends  upon  a variety  of  factors 
'which  are  still  the  subject  of  experimental  investigation  (3:3). 

This  research  does  not  address  individual  differences  in 
simulators,  but  assumes  homogeneity  in  simulator  training  capability. 
That  is,  each  simulator  supporting  a weapon  system  is  adequately 
training  the  pilot  for  his  flight  environment.  An  examination  was  made 
of  differences  in  s^nulator  time  per  command  (Table  2-8)  for  the 
research  period  (1970-1975).  A similar  examination  was  made  of 
actual  flight  time  per  year  for  that  period.  Simulator  and  flight  time 
per  year  were  then  compared  to  determine  the  flight/ simulator 
ratios  (Tables  2-9  through  2-11).  The  ratios  were  compared  with  pilot 
error  costs  for  the  corresponding  periods.  Using  multiple  regression, 
a general  model  was  developed  to  predict  expected  cost  of  pilot  errors 
(improficiency)  based  on  simulation  and  flight  variables. 

Table  2-8  provides  a summary  of  simulator  hours  for  the 
years  1970-1975.  Tables  2-9  through  2-11  provide  summaries  of 
simulator /flight  ratios  for  the  same  period.  The  simulator  hour  break- 
out per  command  was  only  available  for  1974  and  1975.  All  other  years 
represent  total  time  throughout  the  Air  Force. 
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Table  2-9 


1975  Ratio  SIM/Flight  Hours 


Command 

SIM 

Flight 

Ratio 

ADC 

10,876 

105, 145 

. 10344 

AFE 

23,815 

164, 169 

. 19989 

AFR 

7,883 

131,716 

. 05985 

ANG 

18,431 

386, 767 

. 04765 

ATC 

312,019 

651,977 

.47857 

LOG 

3,536 

13,  649 

. 25907 

MAC 

154,518 

665,382 

.23222 

PAF 

9,257 

234, 359 

.03959 

SAC 

159,  154 

387,  581 

.41063 

SYS 

1, 190 

52,  249 

.02278 

TAC 

85,865 

395,364 

.21718 

*Misc.  Total 

6,605 

44,591 

. 14815 

Total 

793, 150 

3,  180,038 

. 24942 

’“Miscellaneous  includes  all  users  of  simulators  whose  average 
yearly  utilization  rate  is  less  than  1,  000  hours.  Figures  were 
provided  by  Headquarters  Air  Force  Logistics  Command. 


i 

'3 


i 


Table  2-10 
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1975  Ratio  SIM/ Flight  Hours 


Command 

SIM 

Flight 

Ratio 

ADC 

8,334 

136,484 

.06106 

AFE 

20,471 

191,409 

. 10695 

AFR 

7,616 

138,745 

. 05489 

ANG 

24, 847 

416,399 

.05967 

ATC 

242, 194 

800,  699 

. 30248 

LOG 

8,663 

35,221 

. 24596 

MAC 

72,006 

506, 346 

. 14221 

PAF 

9,  389 

372,221 

.02522 

SAC 

85,088 

507,964 

. 16751 

SYS 

2,177 

70,  742 

.03077 

TAC 

125,950 

601,587 

. 20936 

♦Misc.  Total 

2, 119 

96, 926 

.02186 

Total 

608,853 

3, 171,262 

. 19199 

Miscellaneous  includes  all  users  of  simulators  whose  average 
yearly  utilization  rate  is  less  than  1,  000  hours.  Figures  were 
provided  by  Headquarters  Air  Torce  Logistics  Command. 


Table  2-11 


1970-1973  Ratio  SIM/Flight  Hours 


Year 

SIM 

Flight 

Ratio 

1970 

290, 000 

5,697,017 

.0509 

1971 

300, 101 

4, 888, 559 

.06139 

1972 

382, 101 

3,853,228 

.09916 

1973 

424, 556 

3,539,023 

.11996 

* 


CHAPTER  HI 


TESTS  OF  HYPOTHESES 

The  tests  of  hypotheses  were  made  without  employing  infer- 
ential statistics.  This  was  possible  because  a census  of  pilot  error 
accidents,  flight  simulator  usage,  and  flying  hours  was  analyzed. 

The  analyses  consisted  of  making  direct  comparisons  of  aircraft 
accident  data,  total  flying  hours,  and  flight  simulator  data  for  the 
years  1970  through  1975.  This  time  frame  was  divided  into  two 
periods.  Period  I (1970-1972),  representing  the  period  before 
Energy  Conservation  Measures  (ECM)  implementation,  and  Period  11 
(1973-1975),  representing  the  period  after  ECM  implementation. 

The  basic  objective  was  to  determine  if  the  level  of  pilot  pro- 
ficiency has  decreased  since  ECM  implementation.  Pilot  proficiency 
is  defined  as  the  average  cost  per  accident  per  given  time  period. 
This  cost,  along  with  the  associated  flight  hours,  simulator  hours, 
fatality  count,  and  percent  of  aircraft  destroyed  were  used  to  com- 
pare pilot  proficiency  before  and  after  ECM  implementation.  In 
other  words,  the  average  deflated  cost  of  accidents  resulting  from 
pilot  errors  is  a measure  of  pilot  proficiency.  A decrease  in  profi- 
ciency is  reflected  in  the  seriousness  of  pilot  errors,  which,  in  turn. 
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is  reflected  by  increased  costa  of  pilot  error  accidents.  In  addition 
to  increased  cost  (resulting  from  decreased  proficiency)*  it  also 
follows  that  the  percent  of  fatalities  and  percent  of  aircraft  destroyed 
should  increase  with  a decrease  in  pilot  proficiency.  These  factors 
were  examined  and  compared  for  the  two  periods  to  ascertain  the 
affects  of  increased  simulation  and  reduced  flying  time  on  pilot  pro- 
ficiency. 

RESEARCH  HYPOTHESES 

(I)  There  has  been  a decrease  in  total  pilot  flying  proficiency 
since  1972  (implementation  of  energy  conservation  measures). 

(U)  The  decrease  in  flying  proficiency  can  be  attributed  to 
reductions  in  actual  flight  hours  and  to  increases  in  the  use  of  flight 
simulators  as  a substitute  for  actual  flight  in  maintaining  flying  pro- 
ficiency. 

ASSUMPTIONS 

(a)  The  time  period  from  which  the  historical  data  are 
selected  (January  1970  through  December  1975)  is  of  sufficient  length 
to  yield  valid  data  pertaining  to  the  objective  of  this  study. 

(b)  Pilots  with  more  than  700  hours  total  flying  time  should 
possess  the  skills  necessary  to  perform  at  optimum  proficiency  levels. 
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c.  The  current  simulators  are  being  utilised  for  minimum 
training  effectiveness  and  homogeneity  exists  in  simulator  training 
capability. 

d.  All  pilots  were  current  as  aircraft  commanders  and/or 
instructor  pilots,  in  accordance  with  Air  Force  Regulation  51 -XX. 

e.  Homogeneity  exists  in  basic  skills  acquired  by  the  pilot 
population. 


LIMITATIONS 

a.  This  research  considered  only  those  aircraft  common  to 
all  years  of  the  historical  period.  The  newer  series  of  aircraft  (e.  g. , 
F-15,  C-5A)  were  not  considered. 

b.  The  conclusions  derived  from  this  research  apply  only  to 
Air  Force  pilots  with  more  than  700  hours  total  aircraft  commander 
time  and/or  instructor  pilot  time,  involved  in  major  aircraft  acci- 
dents. Predictions  are  only  valid  for  the  range  of  data  collected. 
Predictions  of  characteristics  concerning  different  populations  are 
based  upon  logical  inferences  only. 

Results  of  Analysis 

A statistical  summary  of  pilot  error  accident  data  is  presented 
in  Table  3-1.  The  pilot  error  accident  costs  were  adjusted  to  1970 
dollars  to  provide  parity  in  comparing  cost  figures.  The  fatality 
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figures  in  Table  3-1  represent  one  fatality  for  each  accident  in  which  ) 

a fatality  or  fatalities  occurred.  This  was  done  to  provide  parity 
when  comparing  multiplace  aircraft  with  single  place  aircraft. 

\ 

Figure  3-1  graphically  displays  the  total  cost  of  accidents  for 
1970  through  1975.  All  cost  figures  are  adjusted  to  1970  dollars. 

§ 

Figure  3-2  graphically  displays  the  average  cost  of  accidents 
for  the  period  1970  through  1975.  | 

In  order  to  compare  pre-ECM  and  post-ECM  pilot  proficiency, 

1970  through  1972  was  designated  Period  I (pre-ECM)  and  1973 
through  1975  was  designated  Period  II  (post-ECM).  Accident  statis- 
tics for  Periods  I and  n are  presented  in  Table  3-2.  The  total  cost 
of  pilot  error  accidents  for  Period  I was  $209,  702,491,  while  the  total 
cost  of  accidents  for  Period  II  was  $140,  558,  264.  Although  this  repre- 
ss* ! a a reduction  in  pilot  error  cost  of  $69,  144,  227,  the  average  cost 
per  accident  increased  from  $1,505,  976  for  Period  I,  to  $1,  978, 786 
in  Period  II,  (Reference  Table  3-2).  This  represents  an  increase  in 
the  severity  of  pilot  errors  by  $472,810  for  each  occurrence. 

Graphical  representations  of  pilot  errors  resulting  in  fatalities 
are  presented  in  Figures  3-4  and  3-5.  In  Period  I,  pilot  errors 

, . . — - — 

resulted  in  40  fatalities  while  in  Period  II  pilot  errors  resulted  in  33 

f 

1 

fatalities  (Reference  Table  3-2).  While  this  represents  a decrease  in  ;$ 

't 

i 

total  fatalities  from  Period  I to  Period  II,  the  average  fatality  per 


accident  increased  from  . 28  to  . 46.  That  is,  the  increased  severity  1 


id  just  each  year's  dollar  value  to  1970  base  year. 
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Table  3-2 


Statistical  Data  Comparison 
Period  I (1970-72)  vs  Period  II  (1973-75) 
Air  Force  Aircraft  Accidents 


Total  Accident 

Total  Number 

Total 

Period 

Cost 

of  Accidents 

Fatalities 

I 

$209,702,491 

141 

40 

II 

140,558,  264 

72 

33 

Average  Cost / 

Average  Fatalities/ 

Period 

Accident 

Accident 

I 

$1,  505,  976 

.28 

11 

1,978,786 

.46 

Period 


Figure  3-3 

Average  Cost/Accident 


1.0- 


.6- 


1970  71  72  73  74  75 

Year 


Figure  3-4 

Fatalities/Accident:  Percentage 
Comparison  (1970-1975) 


1 II 


Period 
Figure  3-5 
Fatalities /Acc  ident 
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o£  pilot  error  resulted  in  a 64%  increase  in  average  fatalities  per 
accident  in  Period  11. 

Pilot  improficiency  was  also  analyzed  in  terms  of  aircraft 
destroyed.  The  assertion  is  that  the  seriousness  of  a pilot  error  can 
be  judged  by  the  extent  of  damage  done  to  an  aircraft.  In  Period  I, 

75. 18%  of  all  pilot  errors  resulted  in  destruction  of  the  aircraft 
beyond  economical  repair,  while  in  Period  II,  81.94%  of  pilot  errors 
resulted  in  total  aircraft  destruction  (Reference  Table  3-3).  This 
represents  an  8.99%  increase  in  the  number  of  aircraft  destroyed 
from  Period  I to  Period  II. 

The  decrease  in  total  cost,  total  number  of  fatalities,  and 
total  number  of  aircraft  destroyed  follows  the  total  reduction  in  flying 
time  from  Period  I to  Period  II  (Reference  Tables  3-4  and  3-5).  In 
Period  I,  total  flying  time  for  the  Air  Force  was  14,438,  804  hours 
while  in  Period  II  it  was  9,  890,  323.  This  represents  a 31.  5%  reduc- 
tion in  flying  time  from  Period  I to  Period  II.  Concurrently,  the 
simulator  time  was  increased  from  972,202  hours  to  1,826,559  hours 
(Reference  Figures  3-6  and  3-7).  This  87.8%  increase  in  simulator 
hours  purportedly  would  compensate  for  the  reduction  in  flying  hours, 
and  maintain  the  same  level  of  pilot  proficiency. 


Table  3-4 
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Yearly  Comparison  of  Flight/SIM  Hours 


Year 

Adjusted  Average 
Cost/Accident 

Flight  Hours 

SIM  Hours 

Flight/ 
SIM  Ratio 

1970 

$1,  225,  389 

5,  697,  017 

290,  000 

19.  6:1 

1971 

1,  294,080 

4,888,  559 

300, 101 

16.  3:1 

1972 

1,998,460 

3,853,  228 

382,  101 

10. 1:1 

1973 

1,892,876 

3,  539,  023 

424,556 

8.3:1 

1974 

1,  797,783 

3, 171,  262 

608,853 

5.  2:1 

1975 

2,  245,698 

3,  180,  038 

793,  150 

4.0:1 

Flight  Hours 
ISimulator  Hours 

Figure  3-7 

Yearly  Flight/SIM  Hours 


Table  3-5 

Period  I and  II  Comparison  of  Flight/SIM  Hours 


Period 


Average  Cost/ 
Accident 

Total 

Flight  Hours 

Total 

SIM  Hours 

$1,505,976 
1,  978,786 

14,438,  804 
9,890,  323 

972,202 
1,826,  559 

FI  f /SIM 
Ratio 


14.9:1 


CHAPTER  IV 


FURTHER  ACCIDENT  ANALYSIS 

This  chapter  provides  a more  detailed  analysis  of  pilot  error 
accidents  by  considering  the  affect  of  the  variables,  total  instructor 
pilot  time,  simulator/flight  ratio,  phase  of  flight,  cost  of  accident, 
and  type  of  aircraft.  Data  for  the  years  1974  and  1975  were  analyzed 
in  order  to  determine  current  trends  in  pilot  errors  since  the  imple- 
mentation of  energy  conservation  measures  which  marked  the  greater 
use  of  simulation  as  a substitute  for  actual  flight  (Reference  Tables 
2-2,  2-3,  2-9  and  2-10).  The  Statistical  Package  for  the  Social 
Sciences  (SPSS)  provided  the  computerized  data  analysis.  All  possible 
combinations  of  variables  were  analyzed  for  significance.  The  most 
significant  tests  will  be  presented. 

The  first  series  of  tests  were  performed  using  the  SPSS  code- 
book program.  Table  4-1  gives  an  analysis  of  the  30  types  of  aircraft 
involved  in  pilot  error  accidents  in  1974  and  1975.  Table  4-2  is  an 
analysis  of  the  cost  of  the  56  major  aircraft  accidents  resulting  from 
pilot  error  in  1974  and  1975. 

Table  4-3  gives  an  analysis  of  1974  and  1975  accidents  accord- 
ing to  simulator/flight  ratio  of  the  parent  command. 
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Table  4-1 

Analysis  of  Accidents  by  Aircraft  Type 


Type 

A/C 

Value 

Absolute 

Frequency 

Relative 

Frequency 

(Percent) 

Adjusted 

Frequency 

(Percent) 

Cumulative 
Adj  Freq 
(Percent) 

A7 

1 

8 

14.  3 

14.3 

14.  3 

A37 

2 

2 

3.6 

3.6 

17.9 

B52 

3 

2 

3.6 

3.6 

21.4 

C130 

4 

1 

1.8 

1.8 

23.  2 

F100F 

5 

1 

1.8 

1.8  | 

25.0 

F101B 

6 

1 

1.8 

1.8 

26.  8 

T102A 

7 

1 

1.8 

1.8  i 

28.  6 

F104C 

8 

1 

1.8 

1.8 

30.4 

F104G 

9 

1 

1.8 

1.8 

32.  1 

F105D 

10 

2 

3.6 

3.6 

35.7 

F105G 

11 

1 

1.8 

1.8 

37.5 

F106A 

12 

3 

5.4 

5.4 

42.  9 

F111D 

13 

1 

1.8 

1.8 

44.  6 

F111F 

14 

3 

5.4 

5.4 

50.  0 

F4C 

15 

2 

3.6 

3.  6 

53.6 

F4D 

16 

5 

8.  9 

8.9 

62.  5 

F4E 

17 

1 

1.8 

1.8 

64.3 

FB111 

18 

1 

1.8 

1.8 

66.  1 

HH1H 

19 

1 

1.8 

1.8 

67.9 

KC135 

20 

1 

1.8 

1.8 

69.6 

02A 

21 

3 

5.4 

5.4 

75.0 

OVIOA 

22 

1 

1.8 

1.8 

76.8 

RF101C 

23 

1 

1.8 

1.8 

78.6 

RF4C 

24 

2 

3.  6 

3.6 

82.  1 

T33A 

25 

2 

3.  6 

3.6 

85.7 

T38A 

26 

2 

3.6 

3.6 

89.3 

T39A 

27 

1 

1.8 

1.8 

91.1 

U100 

28 

3 

5.4 

5.4 

96.4 

VT29C 

29 

1 

1.8 

1.8 

98.2 

VT29D 

30 

_1 

1.8 

1.8 

100.0 

Total 

56 

100.0 

100.0 

100.0 

Table  4-1  (continued) 
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Aircraft  Type  Summary  Statistics 


Mean 

14. 125 

Std  Error 

1.230 

1 Mode 

1.000 

Std  Dev 

9.203 

Kurtosis 

-1.206 

Skewness 

0.  005 

Minimum 

j 

1.000 

Maximum 

30.000 

1 Median 

14. 500 

Variance 

84. 693 

Range 

29.000 

Valid  Observations  56 

Missing  Observations  0 
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Table  4-2 

Analysis  of  Aircraft  Accidents  by  Cost 


Cost 

Absolute 
Frequency  ! 

Relative 

Frequency 

(Percent) 

Adjusted 

Frequency 

(Percent) 

Cumulative 
Adj  Freq 
(Percent) 

5,000 

1 

led 

1.8 

1.8 

6,000 

1 

1.8 

1.8 

3.6 

6,635 

1 

1.8 

1.8 

5.4 

12,513 

1 

1.8 

1.8 

7. 1 

28, 885 

1 

1.8 

1.8  | 

8.9 

64, 703 

1 

1.8 

1.8 

10.7 

72, 725 

1 

1.8 

1.8 

12.  5 

91,631 

2 

3.6 

3,6 

16.  1 

92, 188 

1 

1.8 

1.8 

17.9 

105,811 

1 

1.8 

1.8 

19.6 

117,399 

1 

1.8 

1.8 

21.4 

121,540 

1 

1.8 

1.8 

23.2 

148, 000 

2 

3.6 

3.6 

26.8 

169,625 

1 

1.8 

1.8 

28.6 

186, 199 

1 

1.8 

1.8 

30.4 

323,  966 

1 

1.8 

1.8 

32.  1 

445, 000 

1 

1.8 

1.8 

33.9 

447, 000 

1 

1.8 

1.8 

35.7 

461,893 

1 

1.8 

1.8 

37.  5 

753,000 

1 

1.8 

1.8 

39.  3 

756, 000 

1 

1.8 

1.8 

41.  1 

804, 444 

1 

1.8 

1.8 

42.9 

810,000 

1 

1.8 

1.8 

44.  6 

843,880 

1 

1.8 

1.8 

46.4 

980, 000 

1 

1.8 

1.8 

48.2 

1,  195,  371 

1 

1.8 

1.8 

50.0 

1,276,  145 

1 

1.8 

1.8 

51.8 

1,681,  592 

1 

1.8 

1.8 

53.6 

1,915,051 

1 

1.8 

1.8 

55.4 

1,947,  194 

2 

3.6 

3.6 

58.9 

2, 064, 000 

1 

1.8 

1.8 

60.7  . 

2,  136,668 

1 

1.8 

1.8 

62.5 

2,  327,000 

2 

3.6 

3.6 

66.1 

2,  327, 968 

1 

1.8 

1.8 

67.9 

2,  479,  000 

1 

1.8 

1.8 

69.6 

2,488,000 

1 

1.8 

1.8 

71.4 
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Table  4-2  (continued) 


Cost 

Absolute 

Freauencv 

Relative 

Frequency 

(Percent) 

Adjusted 

Frequency 

(Percent) 

Cumulative 
Adj  Freq 
(Percent) 

2,517,000 

2 

3.6 

3.6 

75.0 

2,  526,000 

1 

1.8 

1.8 

76.8 

2,  526,  289 

1 

1.8 

1.8 

78.6 

2,  526,468 

1 

1.8 

1.8 

80.4 

2,  575,403 

1 

1.8 

1.8 

82. 1 

2,  663,089 

1 

1.  8 

1.8 

83.9 

3,  393,  000 

1 

1.8 

1.8 

85.7 

3,699,641 

1 

1.  8 

1.8 

87.5 

4,692,173 

1 

1.8 

1.8 

89.3 

6,562,875 

1 

1.8 

1.8 

91. 1 

8,039,  000 

1 

1.8 

1.8 

92.9 

9,829,000 

1 

1.8 

1.8 

94.6 

10, 970, 000 

1 

1.8 

1.8 

96.4 

11,877,136 

1 

1.8 

1.8 

98.7 

13,  195,500 

1 

1.8 

1.8 

100.0 

Total 

56 

100.0 

100.  0 

100.  0 

Accident  Cost  Summary  Statistics 


Mean 

Mode 

Kurtosis 

Minimum 


219900.438 

947194.000 

4.228 

5000.000 


Std  Error 
Std  Dev 
Skewness 
Maximum 


409373. 176 
063468. 344 
2.186 

195500.000 


Median  235758. 000 

Variance  0. 938E  13 
Range  190500.000 

Valid  Observations  56 

Missing  Observations  0 


R 

p 


Accident  Analysis  Based  on  Simulator/ 
Flight  Ratio  of  Parent  Command 


r: 


SIM/ Fit 
Ratio 

Absolute 

Frequency 

Relative 

Frequency 

(Percent) 

Adjusted 

Frequency 

(Percent) 

Cumulative 
Adj  Freq 
(Percent) 

0.039590 

1 

1.8 

1.8 

1.8 

0. 047650 

3 

5.4 

5.4 

7.  1 

0.059600 

3 

5.4 

5.4 

12.5 

0. 059670 

7 

12.5 

12.5 

25.0 

0.061060 

5 

8.9 

8.9 

33.9 

0. 103440 

5 

8.  9 

8.9 

42.9 

0. 167510 

3 

5.4 

5.4 

48.2 

0.209360 

14 

25.0 

25.0 

73.2 

0.217180 

11 

19.6 

19.6 

92.9 

0.302480 

3 

5.4 

5.4 

98.2 

0.478570 

1 

1.8 

1.8 

100.0 

Total 

56 

100.0 

100.0 

100.0 

Simulator /Flight  Ratio  Summary 
Statistics 


Mean 

0. 157 

Std  Error 

0.012 

Mode 

0.209 

Std  Dev 

0.090 

Kurtosis 

0.932 

Skewness 

0.657 

Medium 

0.040 

Maximum 

0.479 

Median 

0. 190 

Variance 

0.  008 

Range 

0.439 
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Table  4-4  provides  an  analysis  of  1974  and  1975  accidents 
according  to  phase  of  flight.  The  following  codes  are  used  to  denote 


phases  of  flight; 


Phase  1 Low  Level 

Phase  2 Air  to  Ground  Ordnance  Delivery 

Phase  3 In-Flight  Normal 

Phase  4 Descent  and  Landing 

Phase  5 Takeoff  and  Climb  Out 

Table  4-5  analyzes  the  accident  data  according  to  instructor 
pilot/first  pilot  (IP/FP)  time  of  the  pilot  in  command  of  the  aircraft. 


Table  4-4 


Accident  Analysis  by  Phase  of  Flight 


Phase  of  Flight 


Low  Level  1 

Air  to  Ground  Ord-  2 
nance  Delivery 

In-Flight  Normal  3 

Descent  & Landing  4 

Takeoff  and  Climb  5 
Out 


Relative  Adjusted  Cumulative 
Absolute  Frequency  Freq  Adj  Fre 


16.1 


25.0 


42.9 


10.7 


100.0 


25.0 


42.9 


10.7 


100.0 


21.4 


46.4 


89.3 


100.0 


100.0 


Note:  Table  4-4  developed  using  SPSS  codebook  computer  program. 

Figures  represent  1974  and  1975  major  aircraft  accidents  with 
pilot  error  as  primary  cause. 
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Table  4-5 

Accident  Analysis  Based  on  Instructor  Pilot/ 
First  Pilot  Time  of  Pilot  in  Command 


Absolute 

Frequency 

Relative 

Frequency 

(Percent) 

Adjusted 

Frequency 

(Percent) 

Cumulative 
Adj  Freq 
(Percent) 

749 

1 

1.8 

1.8 

1.8 

750 

1 

1.8 

1.8 

3.6 

760 

1 

1.  8 

1.8 

5.4 

789 

1 

1.8 

1.8 

7. 1 

791 

1 

1.8 

1.8 

8.9 

797 

1 

1.8 

1.8 

10.  7 

836 

1 

1.8 

1.8 

12.5 

364 

1 

1.8 

1.8 

14.3 

919 

1 

1.8 

1.8 

16. 1 

1057 

1 

1.8 

1.8 

17.9 

1082 

1 

1.8 

1.8 

19.6 

1086 

1 

1.8 

1.8 

21.4 

1095 

1 

1.8 

1.8 

23.2 

1155 

1 

1.8 

1.8 

25.0 

1192 

1 

1.8 

1.8 

26.8 

1244 

1 

1.  8 

1.8 

28.6 

1257 

2 

3.6 

3.6 

32.  1 

1272 

1 

1.  8 

1.8 

33.9 

1355 

1 

1.8 

1.8 

35.7 

1388 

1 

1.8 

1.8 

37.5 

1395 

1 

1.8 

1.8 

39.3 

1399 

1 

1.8 

1.8 

41. 1 

1416 

2 

3.6 

3.6 

44.6 

1587 

1 

1.8 

1.8 

46.4 

1609 

1 

1.  8 

1.8 

48.2 

1622 

1 

1.  8 

1.8 

50.0 

1624 

1 

1.8 

1.8 

51.8 

1730 

1 

1.8 

1.8 

53.6 

1778 

1 

1.  8 

1.8 

55.4 

1828 

1 

1.8 

1.8 

57. 1 

1864 

1 

1.  8 

1.8 

58.9 

1916 

1 

1.8 

1.8 

60.7 

2096 

1 

1.  8 

1.8 

62.5 

2103 

2 

3.6 

3.6 

66. 1 

2155 

1 

1.8 

1.8 

67.9 

2161 

1 

1.8 

1.8 

69.6 

Using  SPSS  crosstabs  computer  program,  the  accident  vari- 
ables were  analyzed  for  interrelationships.  A crosstabulation  of 
cost  of  accident  by  aircraft  type  is  shown  below: 

Chi  Square  » 1624.00047  Significance  = 0.0008 

Contingency  Coefficient  = .98319 

The  Chi  Square  test  of  independence  indicates  that  both  cost 
and  aircraft  type  are  dependent  at  a confidence  level  of  99.  99%. 

The  measure  of  the  extent  of  association  or  relation  between 
cost  and  aircraft  type  has  a contingency  coefficient  of  . 98319.  A 
crosstabulation  of  simulator/flight  ratio  by  aircraft  type  is  shown 
below: 


Chi  Square  = 497.  34236  Significance  = 0.  000 
Contingency  Coefficient  = . 94805 

The  variability  of  simulator /flight  ratio  and  aircraft  type 
follow  a Chi  Square  distribution  with  a dependency  relationship  with 
100%  confidence. 

Simulator  /flight  is  highly  contingent  on  the  type  of  aircraft. 
A crosstabulation  of  IP/FP  time  by  aircraft  type  is  given  below: 

Chi  Square  - 1540.00041  Significance  « 0. 1315 


Contingency  Coefficient  = 0.  98230 
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Chi  Square  test  of  independence  between  IP/FP  time  and 
aircraft  type  shows  a relationship  significant,  with  86,  85%  confidence. 

Type  of  aircraft  is  98.  2%  contingent  on  IP/FP  time.  A 
cross  tabulation  of  the  five  phases  of  flight  by  aircraft  type  is  given 
below: 

Chi  Square  = 104.40648  Significance  = 0.2271 

Contingency  Coefficient  = 0.  806778 

Chi  Square  test  of  independence  between  phase  of  flight  and 
aircraft  type  shows  a dependency  relationship  at  the  87.  29%  confidence 
level. 

Phase  of  flight  is  80.68%  contingent  on  aircraft  type. 

ANALYSIS  OF  VARIANCE 


Using  SPSS  ANOVA  computer  program,  an  analysis  was 
made  on  accident  variables. 

Test  number  1 (Reference  Table  4-6)  analyzed  the  variance 
in  cost  of  accident  by  aircraft  type.  The  results  are  given  below. 


ANOVA  Table 


Sum  of  Sauares 

Degrees  of  Freedom 

Mean 

Square 

Between  groups 

0.4902 

29 

0. 1690 

Within  groups 

0.  2596 

26 

0.  9983 

Total 

0.5162 
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Table  4-6  (continued) 
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Fs  = 16.  9322 

« = . 001  99.  9%  confidence 

Fc  = 3.  44 


There  is  a significant  difference  in  at  least  one  pair  of 
means.  Further  analysis  using  Scheffe's  interval  (Wonnacott, 
Introductory  Statistics.  1972)  provide  the  following. 


HQ:  uru2=0 
h1!  “l'^J10 

<*r*2>±  VF-O0Ir(»-l)  * 

+ y 3.  44  * y.  9983  * ^ 29  2 


+ 1.9193 


Note:  H0,  can  be  rejected  for  all  differences  in  mean  (Reference 
Table  4-6,  mean). 

The  differences  in  mean  cost  of  accidents  are  statistically 
significant  in  that  none  of  the  differences  in  means  enclose  the  value 
of  zero.  This  statement  is  true  with  99.  9%  confidence. 
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A second  ANOVA  analyzed  simulator /flight  ratio  by  type  of 
aircraft  (Reference  Table  4-7).  Results  are  shown  below. 


ANOVA  Table 

Mean 

Sum  of  Squares  Degrees  of  Freedom  Square 


Between  groups  0.  4475 

Within  groups  0.  0027 

Total  0. 4502 


F = 148.0843 
s 

“ = .001 


99.9%  Confidence 


0.0154 

0.0001 


F =3.44 
c 


There  is  a significant  difference  in  at  least  two  means.  Further 
analysis  is  made  using  Scheffe's  interval. 

H0:  uru2=0 

Hj:  u^-uj^O 

(Xrx2)  + V 3.44  * ^ 0001  * J 29.2 


(Xi-X2)  + . 018875 

Note  that  Hq  cannot  be  rejected  for  F100F,  F101B,  F102A,  F104G, 
F105D,  and  OV10A. 

A significant  difference  exists  in  some  mean  simulator/flight 
ratios  at  the  99.  9%  confidence  level.  For  aircraft  with  similar 
performance  capability,  the  difference  in  means  is  not  significant. 
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For  example,  no  difference  in  mean  simulator/flight  ratio  exists 
between  F101B,  F102A,  F104C,  F105D,  F105G  and  F101B.  How- 
ever, there  is  a significant  difference  between  the  above  aircraft 
and  heavier  aircraft  (VT29D,  KC135,  FB111). 

A third  ANOVA  analyzed  instructor  pilot/first  pilot  time  by 
type  of  aircraft  (Reference  Table  4-8). 


ANOVA  Table 

Sum  of  Squares  Degrees  of  Freedom 


Mean 

Square 


Between  groups  66519064.000 

Within  groups  18407273.250 

Total  84926337. 000 


29  2293760.8125 

26  707972. 0469 
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Fs  = 3.  2399 

“ =.  10  90%  Confidence 

Fc  = 1.65 

Note:  Cannot  reject  Hq.  There  is  no  significant  difference  between 
means.  That  is,  the  type  of  aircraft  is  not  a factor  in  determining 
1P/FP  time.  This  statement  is  true  with  90%  confidence. 
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8 (continued) 


CHAPTER  V 


PREDICTION  MODELS  FOR 
IMPROFICIENCY  COST 

A general  prediction  model  was  developed  using  accident 
data  for  1974  and  1975.  The  model  was  developed  to  predict  the 
expected  improficiency  cost,  given  the  allocations  of  flying  and  simu- 
lator  time.  Data  represent  post  implementation  of  energy  conserva- 
tion measures  (ECM).  Although  1973  was  the  first  year  of  ECM,  it 
was  not  included  in  the  development  of  the  prediction  model.  The 
year  1973  was  considered  to  be  a transition  period  in  that  full  imple- 
mentation of  ECM  was  not  realized  and  consequently,  significant 
variations  exist  between  1973  and  later  years.  1974  and  1975  were 
assumed  to  represent  the  steady  state  of  ECM  implementation. 

The  model  will  determine  the  expected  pilot  proficiency  level 
in  terms  of  pilot  error  :ost  (pilot  improficiency).  The  general  model 
was  developed  using  observed  mixes  of  simulation  hours  and  flying 
hours  per  each  three  month  period  during  1974  and  1975.  These 
figures  are  regressed  against  the  corresponding  pilot  error  costs  for 
the  same  three-month  periods.  By  using  multiple  regression  tech- 
niques, the  model  will  determine  the  relationship  between  actual  flying 


67 


68 


* 

i 


time  (AFT^),  simulated  flying  time  (SFTj),  and  pilot  proficiency  (F^) 
in  terms  of  dollar  amounts. 

Prediction  Model;  P£  = A£  + (SFTj)  + B2  (AFTt)  + e 


A^  = A constant  in  the  prediction  model,  determined  by  the 
data  in  the  regression  technique.  Aj  is  the  point  of 
intersection  of  the  regression  plane  and  the  y-axis. 

e = Innate  differences  in  ability,  assumed  constant  in  this 
model. 

Table  5-1  gives  data  for  1974  and  1975  used  to  develop  the  general 
model.  Figure  5-1  graphically  depicts  the  simulation,  flying  and 
cost  data. 

Table  5-1 


Pilot  Error  Costs,  Simulator  Hours,  and  Flying  Hours 
Data  Summary  (1974-1975) 


Cost  of 

Pilot 

Errors 

Simulator 

Time 

(Hrs) 

Flying 

Time 

(Hrs) 

Simulation 

Flight 

Ratio 

Jan-Apr  74 

$24,545,253 

234, 915 

1, 163, 146 

.20197 

May- Aug  74 

20,669,475 

181,642 

1,002,  292 

. 18123 

Sep -Dec  74 

21,441,630 

192,  296 

1,034,  463 

. 18589 

Jan-Apr  75 

16,915,337 

259,868 

1,431,496 

. 18154 

May- Aug  75 

17,  721,433 

266, 386 

1,441,609 

. 18478 

Sep-Dec  75 

17,301,189 

266,898 

1,472,084 

. 18130 

Apr  74  Aug  74  Dec  74  Apr  75  Aug  75  Dec  75 
January  1974--December  1975 


Coet  * 
Simulator  Time 
Flying  Time 


Figure  5-1 


Pilot  Error  Costs,  Simulator  Hours,  and  Flying 
Hours  Data  Summary  (1970-1975) 
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MULTIPLE  REGRESSION  ANALYSIS 

Regression  Analysis:  (Reference  Table  5-2).  Regression  of 
simulator  time  and  flight  time  on  pilot  error  cost  (improficiency  cost) 
results  in  the  following  sample  model. 

P.  = A£  + Bi  (SFTj)  + (-)  B2  (AFTp 

Pi  = 29.  11850  + 213.02146  (SFT^  - 47.02118  (AFT^ 

where: 

Pi  = improficiency  cost 
SFTj  = simulator  hours 
AFTi  = flight  hours 
Ai  = constant 

The  model  indicates  that  as  the  flight  hours  increase  (SFTi 
remains  constant),  pilot  proficiency  increases  as  indicated  by  reduced 
pilot  error  cost;  as  simulator  hours  increase  (AFTi  constant) 

the  pilot  error  cost  increases. 

The  model  will  predict  pilot  error  cost  for  the  range  of 
observed  data  with  95%  confidence.  T-tests  on  the  individual  regres- 
sion coefficients,  B}  and  B 2,  follows  (Reference  Figure  5-2): 

* 10.  6038  tc  * + 2.  776 

*B2:tg  * -13.  264  */2  * . 025 

^Values  taken  from  Table  5-2. 


df  = 4 
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Table  5-2 

Regression  Analysis 


Coefficient  of  Determination  (R^):  0.9887711 

Standard  Error  of  the  Estimate,  S:  0.4097839 


Analysis  of  Variance  Table 


Source 

Variation(s) 

DF 

Mean  Square 

_F_ 

Explained 

44.359726 

2 

22. 179863 

132. 083660 

Error 

0. 503769 

3 

0. 167923 

Total 

44.863495 

5 

Variable 

Coefficient 

Standard  Err ^r 

T Ratio 

0 

29. 11805 

1. 13880 

25.56903 

2 

213.02146 

20.26774 

10.  51037 

3 

-47. 02118 

3.57642 

13. 14756 

Note:  Model  and  analysis  developed  using  MI, REG  computer  program. 

See  Statistical  Tests 

Figure  5-2:  t-Test  of  individual  B^s 
Figure  5-3:  F-Test  on  overall  regression 
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t-Test  of  Individual  B^s 


t-Test 


Figure  5-2 

t-Test:  Linearity  Test  of  Statistical  Data 


tc  = + 2.776 
«/2  = .025 
df  = 4 
H0*i  * 0 

Hj:bj  i 0 

itci<  lt— I Reject  Hq,  there  is  a linear  relationship  between 
simulator  hours,  flying  hours  and  pilot  error  cost. 


I 


] 

i 

) 

\ 


L 


-<■  * 


73 


F-Tcst  on  Overall  Model 
H0:BX  = B2  = 0 

* b2  + 0 

« = .05 


Figure  5-3 


F-Test:  A Test  on  Overall  Regression 


*Fg  = 132.  08 


9.55 


®a  .05 


Fc<  Fs  .*.  Reject  H«,  there  is  significant  variability  between 
the  coefficients  Bx  and  Bj.  The  confidence  level 
is  95%. 

'"Note:  Fs  value  extracted  from  computer  printout. 
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The  preceding  statistical  tests  were  selected  in  order  to 
reach  an  objective  decision  as  to  whether  the  hypotheses  are  con- 
firmed by  the  set  of  given  data.  In  the  decision  making  processes  the 
level  of  significance  (°c)  was  set  at  = .05.  That  is,  the  probability 
of  accepting  the  null  hypothesis  (Hq)  is  5%  or  less.  In  both  the  t-Test 
and  F-Test,  the  Hq  was  rejected.  The  results  indicated  that  the  level 
of  confidence,  beta  = 1 - <£),  was  95%  or  greater,  which  indicated 
that  the  alternative  hypothesis  (Hj)  can  be  accepted  with  a confidence 
level  of  95%.  Specifically,  the  results  show  that  significant  linearity 
exists  between  the  individual  Bjs  in  the  t-Test.  Further,  the  F-Test 
shows  that  the  overall  mode  is  significant.  The  conclusion  is  that  the 
prediction  model  is  significant  (reject  Hq)  and  can  be  used  with  at 
least  95%  confidence  to  predict  the  values  of  the  associated  variables 
for  the  range  of  data  selected  for  this  research. 

Test  of  General  Prediction  Model 

To  test  the  accuracy  of  the  general  model,  a second  model 
was  developed  using  quarterly  data  from  January  1974  to  August  1975. 
The  model  was  then  used  to  predict  the  improficiency  cost  for  the 
period  September -Dec ember  1975,  given  the  simulator  and  flying 


hours. 
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The  model  developed  is  shown  below: 
pi  = Ai  + E.  (SFTi)  + B2  (AFT*) 

Pi  = 29.  87  + 220.  90  (SFTi)  - 49.  20  (AFTi) 

P = 29.87  + 220.  90  (.2669)  - 49.  20  (1.472) 

P = 29.  87  + 58.  96  - 72.43 
P = 16.4  million  dollars 

The  value  for  P compares  favorably  with  the  actual  impro- 
ficiency  ccst  of  17.  3 million  dollars  for  the  predicted  period.  Part  of 
the  . 9 million  dollar  difference  can  be  explained  by  the  test  model's 
reduced  accuracy  due  to  the  smaller  sample  size.  Additionally,  some 
error  was  incurred  due  to  rounding  numbers  to  two  decimal  places. 

MODEL  UTILITY 

The  general  prediction  model  can  be  used  by  interested 
officials  to  predict  the  expected  improficiency  cost  given  any  ratio  of 
simulator  to  flying  time  within  the  range  of  those  used  to  formulate 
the  model.  The  model  is  applicable  to  budget  planners  in  estimating 
the  segment  of  expense  associated  with  aircraft  accidents.  The  model 
may  also  be  used  to  further  enhance  the  flying  safety  program  by  pre- 
dicting improficiency  based  on  varying  amounts  of  simulator  and  flying 


time 
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Prediction  Model  for  A-7  Aircraft 

An  attempt  was  made  to  develop  a regression  model  to  pre- 
dict the  cost  of  pilot  improficiency  for  specific  aircraft,  given 
simulator /flight  ratio  and  IP/FP  time.  With  the  exception  of  A-7 
aircraft,  models  computed  were  insignificant  due  to  the  limited 
number  of  observations  (aircraft  accidents)  of  like  aircraft. 

The  A-7  prediction  model  was  developed  using  accident  data 
for  1974  and  1975.  The  total  variation  (R^)  explained  by  the  model 
was  51.48%.  However,  the  F-Test  confirmed  that  the  overall  model 
is  significant  at  the  99%  confidence  level.  A summary  of  the  results 
is  given  below: 

R2  = 0.  5148065 
S = 4.2457174 

AN  OVA  Test 


Source 

Variation  (ss) 

DF 

Mean  Square 

Explained 

248.642056 

2 

124. 321028 

Error 

234. 339512 

13 

18.026116 

Total 

482. 981564 

15 

F-Test  on  Overall  Model 

H0:Bj=B2=0  Hl:Bl*B2*°  « = .01 

F,  * 6.896717  Fc  s 6.  70 


Reject  Hq 
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Variable  Coefficient 


Std  Error 


T Ratio 


Ai 

B, 


0. 32068 
29.74142 
523, 91187 


2.99920 
19. 10356 
311,72696 


0. 10692 
1.55685 
1.68068 


A- 7 Model 

Pi  * Ai  + Bi  (SFRj)  + B2  (Tj,) 

Pi  = 0.  32068  + 29.  74142  (SFR.)  + 523.  91187  (T\) 

where: 


Pi  = improficiency  cost 
SFR.  = simulator /flight  ratio 


* IP/FP  time. 


CHAPTER  VI 
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CONCLUSIONS  AND  RECOMMENDATIONS 

There  has  been  a decrease  in  total  flying  proficiency  since 
the  implementation  of  energy  conservation  measures  in  1972.  The 
decrease  in  pilot  proficiency  as  measured  by  the  cost  of  pilot  error 
accidents  sho-ws  that  the  average  cost  of  pilot  errors  increased  by 
$472,810  from  Period  I (pre-ECM)  to  Period  II  (post-ECM).  During 
the  same  periods,  total  flying  time  was  reduced  by  4,548,481  hours 
and  simulator  hours  increased  by  854,  357  hours.  The  ratio  of  flight 
time  to  simulator  time  changed  from  14.  9:1  for  Period  I to  5.4:1  in 
Period  U.  Simultaneously,  other  indicators  of  pilot  proficiency  such 
as  the  number  of  fatalities  and  the  number  of  aircraft  destroyed 
significantly  increased  in  Period  II.  The  conclusion  is  that  the  present 
level  of  flight  time  is  insufficient  to  maintain  the  level  of  proficiency 
demonstrated  in  Period  I. 

In  examining  the  type  of  errors  committed  in  Period  I versus 
Period  II,  it  is  clear  that  during  Period  I,  the  type  of  errors  com- 
mitted were  less  costly  in  nature  when  compared  with  Period  II.  The 
implications  are  that  reduced  exposure  to  actual  flight  resulted  in  a 
reduction  of  the  total  number  of  errors,  but  the  errors  committed  were 
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of  a more  serious  consequence.  It  is  axiomatic  that  the  only  way  to 
totally  reduce  errors  is  to  cease  flying,  however,  management  has 
determined  that  pilot  proficiency  would  be  maintained  at  the  pre-ECM 
level.  This  means  that  the  present  level  of  flight  time  must  be 
increased,  in  that  simulators  have  not  proven  to  be  a viable  alterna- 
tive to  actual  flight  for  maintaining  pilot  proficiency. 

In  evaluating  the  1974  and  1975  variables  related  to  pilot  error 
accidents  (IP/FP  time,  phase  of  flight,  type  of  aircraft,  simulator/ 
flight  ratio),  the  descent  and  landing  phase  accounted  for  42.  9 percent 
of  all  accidents.  The  conclusion  is  that  simulators  have  failed  to  pro- 
vide the  necessary  realism  in  training  and/or  learning  transfer  to 
maintain  the  desired  level  of  pilot  proficiency  particularly  in  this  phase 
of  flight. 

An  analysis  of  variance  between  types  of  aircraft  and  simula- 
tor/flight ratio  reveals  that  there  is  no  significant  difference  between 
F-102s,  F104Gs,  F-1058,  F-lOOs,  F-lOlBs,  and  F-104Cs.  The  con- 
clusion is  that  similar  requirements  for  simulator  and  flight  time 
exist  for  fighter  type  aircraft.  On  the  contrary,  significant  differences 
exist  between  KC-135s  and  FB-llls  for  example.  Such  differences 
indicate  that  the  simulator/flight  ratio  requirements  vary  among  some 
aircraft,  based  primarily  on  technological  sophistication.  The  impli- 
cations are  that  a tradeoff  is  possible  between  technological  sophisti- 
cation in  aircraft  and  Simula  tor /flight  ratio. 
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Based  on  the  analysis  of  pilot  error  accidents  for  Period  1 
and  Period  II,  the  following  recommendations  are  submitted: 

1.  The  current  level  of  flying  must  be  increased  to  maintain 
flying  proficiency  at  the  pre-ECM  level. 

2.  Simulator  hours,  although  a significant  contributor  to  pilot 
proficiency,  must  be  viewed  as  a supplement  to  flight  vis-a-vis  a sub- 
stitute for  flight. 

3.  Further  study  is  recommended  to  determine  the  cost/ 
benefit  tradeoff  between  simulation  and  actual  flight. 

4.  An  additional  study  should  be  made  after  simulators  cur- 
rently in  R&D  have  become  operational. 

5.  The  allocation  of  flying  and  simulator  hours  at  DOD  level 
should  be  made  after  management  has  determined  an  acceptable  level 
of  pilot  improficiency.  The  model  presented  in  this  thesis  should 
assist  in  arriving  at  this  decision. 
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